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Abstract — Motivated by a host of recent applications requiring 
some amount of redundancy, frames are becoming a standard tool 
in the signal processing toolbox. In this paper, we study a specific 
class of frames, known as discrete Fourier transform (DFT) codes, 
and introduce the notion of systematic frames for this class. This is 
encouraged by application of systematic DFT codes in distributed 
source coding using DFT codes, a new application for frames. 
Studying their extreme eigenvalues, we show that, unlike DFT 
frames, systematic DFT frames are not necessarily tight. Then, we 
come up with conditions for which these frames can be tight. In 
either case, the best and worst systematic frames are established 
from reconstruction error point of view. Eigenvalues of DFT 
frames, and their subframes, play a pivotal role in this work. 

I. Introduction 

A basis is a set of vectors that is used to "uniquely" 
represent any vector as a linear combination of basis elements. 
Frames, as opposed to bases, are "redundant" set of vectors 
which are used for signal representation. Therefore, frames are 
more general than bases as they are not necessarily linearly 
independent, but are complete. What would be the benefit of 
representing a signal with more than the minimum number of 
vectors required for completeness? Frames offer flexibility in 
design and have variety of applications. They show resilience 
to additive noise (including quantization noise), robustness to 
erasure (loss), and numerical stability of reconstruction HI, 
0. With increasing applications, frames are becoming more 
prevalent in signal processing. 

Frames are generally motivated by applications requiring 
some level of redundancy. Among them is distributed source 
coding (DSC) that uses DFT codes, recently introduced in J5]. 
This provides a new application for frame expansion, viewing 
the generator matrix of a DFT code as a frame operator [0]. 
In this paper, we consider this specific type of tight frames 
which are known as DFT codes and used for erasure and error 
correction in the real field [ED-E. 

Motivated by its application in parity-based DSC that uses 
DFT codes J5), we introduce the notion of systematic frames. 
A systematic frame is defined to be a frame that includes the 
identity matrix as a subframe. Since tight frames minimize 
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reconstruction error |]2], JT], we explore systematic tight DFT 
frames. Although it is straightforward to come up with sys- 
tematic DFT frames, we show that systematic "tight" DFT 
frames exist only for specific DFT codes. When such a frame 
does not exist, we will be looking for systematic DFT frames 
with the "best" performance, from minimum mean-squared 
reconstruction error standpoint. We also demonstrate which 
systematic frames are the "worst" in this sense. 

Central to this paper is the properties of the eigenvalues 
of V H V, in which V is a square or non-square submatrix of 
a DFT frameQ Specifically, we present some bounds on the 
extreme eigenvalues of such matrices. These bounds are used 
to determine the conditions required for a systematic frame so 
as to be tight. Besides, eigenvalues are crucial in establishing 
the best and worst systematic frames. 

The paper is organized as follows. In Section [II] we review 
two set of inequalities on the eigenvalues of Hermitian matri- 
ces which are frequently used in this paper. In Section Hill we 
introduce systematic DFT frames and set the ground to study 
their extreme eigenvalues in Section ITvl Section [V] is devoted 
to the evaluation of reconstruction error and classification of 
systematic frames based on that. We conclude in Section [VTI 

II. Definitions and preliminaries 

An n x n Vandermonde matrix with unit complex entries is 
defined by 
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(1) 



in which p € [0, 2tt) and 9 p ^ 8 q for p =/= q, 1 < p, q < n. 
If p = — (p — 1), W becomes the well-known IDFT matrix 
[6|. For this Vandermonde matrix we can write 0, fl8] 

det(WW H ) = \dct(W)\ 2 = \ [I |e w '-e w «| a (2) 

l<p<q<n 

Let A be a Hermitian k x k matrix with real eigenvalues 
{Xi(A), . . . ,Xk(A)} which are collectively called the spec- 
trum of A, and assume Xi(A) > X%(A) > • • • > Xk(A). 

'Note that eigenvalues of V H V and VV are equal for a square V; also, 
V H V and VV H have the same nonzero eigenvalues for a non-square V . 



Schur-Horn inequalities show to what extent the eigenvalues 
of a Hermitian matrix constraint its diagonal entries. 

Proposition 1. Schur-Horn inequalities 49y 
Let A be a Hermitian k x k matrix with real eigenvalues 
Xi{A) > \ 2 {A) >■> A fc (A). Then, for any l<i 1 <i 2 < 
■ ■■ < k < k, 



Then, it is easy to see that, 



X k -i+i(A) H h X k (A) < a nn H h a ilk 

< X 1 (A) + --- + X l {A), 



(3) 



where an, . . . , akk are the diagonal entries of A. Particularly, 
for I — 1 and I — k we obtain 



\k{A) < an < Xi(A), 



(4) 



(5) 



i=i i=i 
Another basic question in linear algebra asks the degree to 
which the eigenvalues of two Hermitian matrices constrain the 
eigenvalues of their sum. Weyl's theorem gives an answer to 
this question in the following set of inequalities. 

Proposition 2. Weyl inequalities 

Let A and B be two Hermitian k x k matrices with spectrums 
{Xi(A), . . . , Xk(A)} and {Ai(-B), . . . , Afc(-B)}, respectively. 
Then, for i,j < k, we have 

Xi{A + B)< Xj (A) + Xi- j+ i(B) for j < i, (6) 
Xi(A + B)> Xj (A) + Xk+i-jiB) for j > i. (7) 

III. DFT Frames 

A. BCH-DFT Codes 

DFT codes 0, are linear block codes over the complex 
field whose parity-check matrix H is defined based on the 
DFT matrix. A Bose-Chaudhuri-Hocquenghem (BCH) DFT 
code is a DFT code that insert d — 1 cyclically adjacent zeros 
in the spectrum of any codevector where d is the designed 
distance of that code flOl . Real BCH-DFT codes, a subset 
of complex BCH-DFT codes, benefit from a generator matrix 
with real entries. The generator matrix of an (n, k) rea{l BCH- 
DFT code is typically defined by 



G = 



(8) 



in which Wi represents the DFT matrix of size I, and £ is 

/ I a \ 
Snxfe =00, (9) 

V o I fi J 

where a — \n/2] — [(n — k)/2\, /3 = k — a, and the sizes of 
zero blocks are such that S is an n x k matrix 1111 . One can 
check that T, H £ = Ik, and SS ff is an n x n matrix given by 

f la \ 

EE H = 0. (10) 
V Ip J 

2 In a real BCH-DFT code, n and k cannot be even simultaneously (3). 



G H G — —I k , 
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GG H = ^W,?W H W n . 
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One can view the generator matrix G in ([8]l as an analysis 
frame operator. The following lemma presents some properties 
of GG H which are central for our results in the next section. 

Lemma 1. Let G pX k be a matrix consisting of p arbitrary 
rows of G defined by (O. Then, the following statements hold: 

i. GG H is a Toeplitz and circulant matrix 

ii. G p xkGp Xk , 1 < p < n is a Toeplitz matrix 

Hi. All principal diagonal entries of G pX kGp Xk , 1 < p < n 
are equal to 1. 

Proof: Let a r . s be the (r, s) entry of the matrix GG H 
then it can readily be shown that 



1 a — 1 1 n — 1 



Jm(e r -0s) 



(13) 



m— 



m=n—/3 



in which 8 X 
that a r , = a 



~-(x — 1). From this equation, it is clear 
; that is, the elements of each diagonal are 



equal, which means that GG H is a Toeplitz matrix. In addition, 
we can check that a rn = <V+i i> i- e -' me l ast entry in each 
row is equal to the first entry of the next row. This proves 
that the Toeplitz matrix GG H is circulant as well 1121 . Also, 
a quick look at ([T3l reveals that the elements of the principal 
diagonal (r = s) are equal to 1. Similarly, one can see that 
for any 1 < p < n, the square matrix G py kG^ yk is also a 
Toeplitz matrix; it is not necessarily circulant, however. ■ 
Removing Wk from © we end up with a complex G, 
representing a complex BCH-DFT code. In such a code, a 
and j3 can be any nonnegative integers such that a + f3 = k. 

Remark 1. Lemma[T]also holds for complex BCH-DFT codes. 

As a result, all properties that we prove in the remainder of 
this paper are valid for "any" BCH-DFT code, although they 
are formally proved for "real" BCH-DFT codes, which we 
simply refer to as "DFT codes" or "DFT frames" hereafter. 

B. Systematic DFT Frames 

In the context of channel coding, there is a special interest 
in systematic codes so as to simplify the decoding algorithm. 
This is more pronounced in "parity-based" DSC as it requires 
distinction between parity and data. The parity-based approach 
becomes even more worthwhile in the DSC that uses DFT 
codes because it is more "efficient" than the syndrome-based 
approach |3|. This is due to the fact that syndrome, even in 
a real DFT code, is a complex vector whereas parity is real. 
This encourages a systematic generator matrix for DFT codes. 

A systematic generator matrix for a real BCH-DFT code 
can be obtained by [3] 

GG k , 



G s 



(14) 



in which Gk is a submatrix (subframe) of G including k 
arbitrary rows of G. Note that Gk is invertible since it can 



be represented as G k = \/rW k H xn EW k = V k H W k , in which 



~ \fry^kY.n^- J i s a Vandermonde matrix. Remember that 
W k is also invertible as it is a DFT matrix. This proves 
that systematic DFT frames exist for any DFT frame. It 
also shows that there are many (but, a finite number of) 
systematic frames for each frame, because the rows of Gk can 
be arbitrarily chosen from those of G. These systematic frames 
differ in the "position" of systematic samples (input data) in 
resulting codewords. This implies that the parity samples are 
not restricted to form a consecutive block in codewords. Such 
a degree of freedom is useful in the sense that one can find 
the most suitable systematic frames for specific applications 
(e.g., one with the smallest reconstruction error.) 

IV. Main Results on the Extreme Eigenvalues 

From rate-distortion theory, it is well known that the rate 
required to transmit a source, with a given distortion, in- 
creases as the variance of the source becomes larger ifPJl . 
Particularly, for Gaussian sources this relation is logarithmic 
with variance, under the mean-squared error (MSE) distortion 
measure. In DSC that uses real-number codes [3], since coding 
is performed before quantization, the variance of transmitted 
sequence depends on the behavior of the encoding matrix. In 
view of rate-distortion theory, it makes a lot of sense to keep 
this variance as small as possible. Not surprisingly, we will 
show that using a tight frame (tight G sys ) for encoding is 
optimal. 

Let x be the message vector and y — G sys x represent 
the codevector generated using the systematic frame, then the 
variance of y is given as 



* 2 y = -E{y H y} = -E{x H Gf ys G sys x} 



and 



n * 
tr (G^y S G sys ) — tr (G fe 111 ' " 



(15) 



Gti f 1 / 1 
k 



tr ((GfcGf 



= ^((v k H v k n 



(16) 



2 — 1 

in which Ai > A2 > • • • > Afc > are the eigenvalues of 
G fc Gf (or V k H V k equivalently). 

This shows that the variance of codevectors, generated by a 
systematic frame, depends on the submatrix G k which is used 
to create G sys . Gk, in turn, is fully known once the position of 
systematic (data) samples is fixed in the codevector. In other 
words, the "position" of systematic samples, determines the 
variance of codevectors generated by a systematic DFT frame. 
From (O, (TToT l. to minimize the effective range of transmitted 
signal, we need to do the following optimization problem. 



minimize 

A; 



k 
i=l 



1 

— s.t. 22 \i = k, Xi> 0, 



(17) 



where, the constraint J2i=i Ai — k is achieved in light of 
Lemma Q] and (0. 

By using the Lagrangian method, we can show that the 
optimal eigenvalues are A,; = 1; this implies a tight frame 
0. In the sequel, we analyze the eigenvalues of G pxk G^ xk , 
p < n, that helps us characterize tight systematic frames, so 
as to minimize the variance of transmitted codevectors. 

Theorem 1. Let G pxk , 1 < p < n be any p x k submatrix 
of G. Then, the smallest eigenvalue of G pxk G^ xk is no more 
than one, and the largest eigenvalue of G pX kG^ xk is at least 
one. 

Proof: From Lemma Q] we know that all principal diag- 
onal entries of G pxk Gp Xk are unity. As a result, using the 
Schur-Horn inequality in (0), we obtain X m i n (G pxk Gp Xk ) < 
1 < \nax(G pX kGp Xk ). This proves the claim. Also, note that 
for any G pX k, X max (G pxk G^ xk ) = X max (Gp Xk G pxk ). B 
We use the above results to find better bounds for the extreme 
eigenvalues of G k G k in the following theorem. 

Theorem 2. For any Gk, a square submatrix of G in (O in 
which n ^ Mk, the smallest (largest) eigenvalue of GkG k is 
strictly upper (lower) bounded by 1. 

Proof: We first investigate a bound for the smallest 
eigenvalue. Let n = Mk + 1,0 < I < k, then G can be 
partitioned as G = [Gf \ G\ H \ ■ ■ • | G^ H \ G^] H . In 
general, Gk,G\, . . . , Gff 1 and G k { xl include arbitrary rows 
of G, hence they have different spectrums, i.e., different sets of 
eigenvalues. We consider the case with largest Afc for G k G k ; 
this occurs when G k consist of the rows of G such that the 
distance between each two successive rows is as large as 
possible and at least M. The latter guarantees existence of 
Gfc, . . . , Gf _1 such that G^G^, for any 1 < m < M - 1, 
has the same spectrum as G k G k . To find the row indices 
corresponding to G™, we can simply add m to each row 
index of G k . Then, to show these matrices have the same 
spectrum, we use Lemma 3 [8 1 which states that any Hermitian 
n x n matrices E and F with Fij — —E^j have the same 
eigenvalues. Now, given a G k , one can verify that {G\)i j — 
«.,((■'>■ ™d thus {GD* = <(Gfc)5 - lMGfc')^. 

Therefore, G\ H G\ and G k G k have the same spectrum. The 

r<M-i 
1 iji 



same argument is valid for G k , . . . , G k VI 1 . Next, we see that 
G H G = A + B in which A = Gf G k + ■■■ + G h M ~ X)H G^ ~ x 
and B — G k Jf G kxl . Then, in consideration of the above 
discussion, Xi(A) = MXi(G k G k ) for any 1 < i < k. Hence, 
from ©, for i = l,j = k, we will have 



X k (A) + Xi(B) < Xx(A + B) 

«. AfAfc(GfGfc) <y-X 1 (B) 
k 

n ^ n 1 

A fc (Gf G k ) < = J^j- < 1, 



(18) 



i=l 



where the last line follows using Xi(B) > 1 from Theorem Q] 
This completes the proof for the worst case, i.e., the largest 
possible X k (G k Gk), and implies that ( TT8l holds for any other 



G k . Hence, the fist part of the proof is completed; that is, the 
smallest eigenvalue of G k G k where Gk is an arbitrary square 
submatrix of G in © with n =f Mk is strictly less than one. 

Finally, knowing that £\ =1 Aj(Gf G k ) = J^ =1 an = k 
and using (f 1 St . it is obvious that Xi(G k G k ) > 1- This proves 
the bound for the largest eigenvalue. 

■ 

Theorem|2]implies that for n ^ Mk we cannot have "tight" 
systematic frames. This is due to the fact that for a tight frame 
with frame operator F, X m - m (F H F) = \ max (F H F); i.e., the 
eigenvalues of F H F are equal 0. 

Corollary 1. For n ^ Mk, where M is a positive integer, 
"tight" systematic DFT frames do not exist. 

Note that systematic DFT frames are not necessarily tight 
for n = Mk. Evaluating the performance of systematic frames 
in the next section, we prove that tight systematic DFT frames 
exist for n = Mk and show how to construct such frames. 

V. Performance Analysis and Classification of 
Systematic Frames 

A. Performance Evaluation 

In this section, we analyze the performance of quantized 
systematic DFT codes using the quantization model proposed 
in 0, which assumes that noise components are uncorrected 
and each noise component g, has mean and variance a 2 . We 
assume the quantizer range covers the dynamic range of all 
codevectors encoded using the systematic DFT code in (TT4| >. 

The codevectors are generated by y = G sys x. We also con- 
sider linear reconstruction of x form y using the pseudoinverse 
of G sys , which is defined as Gj ys = (G^ yB G Bys )^ 1 G^ ys . 
It is easy to check that Gl ys — ^G k G H , then the linear 
reconstmction is given by 



x = Gt ys y = -G k G H y. 



(19) 



Now, suppose we want to estimate x from y — G sys x + q, 
where q represents quantization error. From (fP9l we obtain 

(20) 



-G k G H y = x+*G k G H q. 

n n 



Then, the mean-squared reconstruction error, due to the quan- 
tization noise, using a systematic frame can be written as 

MSE q = ±E{\\x - x\\ 2 } = ±-E{\\Gt ys q\\ 2 } 
= -j-E^G^G^} 
= ^ 2 tr(Gt*Gt ys ) 
= ^2 G \ tr (GGfG fe G ff ) 
= ~ a q tr (G k G k G H G) 

= i^tr(GfG fc ) = ~a 2 , 
n H n H 

where the last step follows because of Lemma [TJ The above 

analysis indicates that the MSE is the same for all systematic 



(21) 



DFT frames of same size, provided that the effective range 
codevectors generated by different G sys is equal. This implies 
a same a 2 q for a given number of quantization levels. However, 
for a fixed number of quantization levels, a 2 depends on the 
variance of transmitted codevectors, which, in turn, varies for 
different systematic frames, as shown in H5) . 

As we discussed in Section iTVl the optimal G sys is achieved 
from the optimization problem (fTTt . Similarly, to find the 
worst G sys , we can maximize ( fTTT i instead of minimizing it. 
The optimal eigenvalues are known to be = 1. But, how 
can we find the corresponding G sys , or G k equivalently? 

We approach this problem by studying another optimization 
problem. By using the Lagrangian method, one can check the 
optimal arguments of the optimization problem in (TTTt are 
equal to those of 



maximize 



\ [ A l S.t. ^ X i = fc > A ' > °> 



(22) 



i=i 



in which {Aj}^ =1 are the eigenvalues of G k G^ (or V k H V k ). 
In other words, subject to the above constraints 



k 1 

argmin t- 

Xi , Aj 



argmax JJ^ A,; 



(23) 



Problem ( f22b has the maximum of 1 and infimum of 0. Then, 
considering that T]Li A « = det (Xjf V k) = det(G fe Gf ), we 
conclude that the "best" submatrix is the one with the largest 
determinant (possibly 1) and the "worst" submatrix is the one 
with smallest determinant. Next, we evaluate the determinant 
of V k H V k so as to find the matrices corresponding to these 
extreme cases. 

B. The Best and Worst Systematic Frames 

In this section, we first evaluate the determinate of WW H 
where W is the Vandermonde matrix with unit complex entries 
as defined in <[TJ. From we can write 

det(ww H ) = 4r II \ el6p - eWq \ 2 

l<p<q<n 

= ^ II 4sin 2 ^(< Z -p) (24) 

n(-^r 



\<p<q<n 
on(n— 1) n — 



in which 9 X = —(x — l),r = q — p, and n(n — l)/2 is the 
total number of terms that satisfy 1 < p < q < n. But, we see 
that W is a DFT matrix, and thus, its determinant must be 1 . 
Therefore, we have 



n( 



7T 

sin" — r 

n 



2n(n— 1) ' 



(25) 



The above analysis helps us evaluate the determinant of V k 
or Gfc, defined in (Tl4t . Let I r = {i ri , i r2 , . . . , i rk } be those 
rows of G used to build G k . Also, without loss of generality, 



assume i ri 
we obtain 



< i r2 < ■ ■ ■ < i rk . Clearly, i ri > 1, i rk < n, and 



det(V k V k H ) 



1 

1 



n 



„ie o |2 



l<p<q<n 
p,qel r 



n Asm 2 -{q-p). 
n 



(26) 



l<p<q<n 
p.qEXr 



Then, since sin-u = sin— (n — u), one can see that this 
determinant depends on the circular distance between rows in 
I r . For a matrix with n rows, we define the circular distance 
between rows p and q as min{|q — p\, n — \q — p\}. In this 
sense, for example, the distance between rows 1 and n is one, 
i.e., they are circularly successive. Now, we can see that (l26l > is 
minimized when the selected rows are (circularly) successive. 
Note that sinu is strictly increasing for u € [0, n/2] and the 
circular distance cannot be greater than n/2, in this problem. 

In such circumstances where all rows in l r are (circularly) 
successive, d26i i is minimal and reduces to 

2 k(k-i) k-i k _ r 

n ( sin n r ) ■ (27) 



det(V k V k H ) 



k k 



The other extreme case comes up when n = Mk (M is a 
positive integer) provided that G k consists of every Mth row 
of G. In such a case d26| i simplifies to 1 because 



det(V k V k H ) = 



nfe(fe- 



k k 

nk{k-l) 



k k 



k-1 

no 

r=l 
k-1 

no 



-Mr 
n 



(28) 



sin 



= 1, 



where the last step follows from (125 1 . Recall that this gives 
the best V k (and equivalently G k ), in light of ( l22l . For 
such a G k , it is easy to see that G sys stands for a "tight" 
systematic frame and minimizes the MSE for a given number 
of quantization levels. Effectively, such a frame is performing 
integer oversampling. There are M such frames; they all have 
the same spectrum, though. 

C. Numerical Examples 

Numerical calculations confirm that "evenly" spaced data 
samples gives rise to systematic frames with the best perfor- 
mance. When a systematic code is doing integer oversampling, 
we end up with tight systematic frames. The first code in 
Table J] is an example of this case. When n ^ Mk, data 
samples cannot be equally spaced; however, as it can be seen 
from the second code in Table U still the best performance is 
achieved when they are as equally spaced as possible. Note 
that, circular shift of codewords pattern does not change the 
spectrum of corresponding matrices. For example, in the (7, 5) 
code, codewords with pattern x — x x x — x and x x — x x — x 
have the same properties. Also, reversal of a codeword yields 

a codeword with similar properties (e.g., x x — x is shifted 

version of reversed x x x— ). 



TABLE I 

Eigenvalues structure for two systematic DFT frames with 

DIFFERENT CODEWORD PATTERNS. A "x" AND "—" RESPECTIVELY 
REPRESENT DATA (SYSTEMATIC) AND PARITY SAMPLES. 



Code 


Codeword 
patern 


A 




s T k , 1/Ai 


U k , Xi 
1 i i=i 




XXX 


0.0572 


1.9428 


19 


0.1111 


(6,3) 


X X — x 


0.2546 


1.7454 


5.5 


0.4444 


XX X — 


0.2546 


1.7454 


5.5 


0.4444 




X — X — X — 


1 


1 


3 


1 




X X X X X 


0.0396 


1.4 


28.70 


0.0827 


(7,5) 


X X X X — X — 


0.1506 


1.4 


10.32 


0.2684 


X X — X X — X 


0.3110 


1.4 


7.40 


0.4173 




X — X X X — X 


0.3110 


1.4 


7.40 


0.4173 



VI. Conclusions 

Systematic DFT frames as well as the approach to make 
such a frame out of the generator matrix of a BCH-DFT 
code has been introduced. Further, we found the conditions 
for which a systematic DFT frame can be tight, too. We 
then related the performance of these frames to the position 
of systematic samples in the codevector. The analysis shows 
that evenly spaced systematic (parity) samples result in the 
minimum reconstruction error, whereas the worst performance 
is achieved when systematic samples are circularly successive. 
Finally, we found the conditions for which a DFT frame 
becomes both systematic and tight. 
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